Method and system for dynamically adjusting camera shots

ABSTRACT

An approach is provided for adjusting camera shots. The approach involves receiving an audio signal via a microphone of a mobile device during video recording of a subject by a camera of the mobile device. The approach also involves determining, at the mobile device, an audio level in a vicinity of the subject based on the received audio signal, wherein the audio level is based on sounds produced by the subject. The approach additionally involves determining that the audio level triggers a shot adjustment state. In the alternative or in addition to, the shot adjustment state is triggered by facial expression of the subject. The approach further involves dynamically adjusting, in response to the shot adjustment state, one or more camera parameters of the camera to alter shot of the subject by the camera during the video recording. The camera parameters relate to either zoom control, aperture, lighting, or a combination thereof.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to U.S. patent application Ser. No.62/639,230, filed on Mar. 6, 2018, entitled “A Software Program thatAdjusts the Aperture and Zoom of a Camera in Response to SoundVariation,” the entirety of which is incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates to adjusting camera shots based on audiolevel or user facial expression.

BACKGROUND OF THE INVENTION

The prevalence and convenience of cameras, particularly by way ofsmartphones, have seen a remarkable growth in “amateur” production ofvideo content. Moreover, the “selfie” generation, coupled with socialmedia outlets, has caused more and more content to be generated. Thenotion of a “selfie” is that the camera operator self-operates thecamera without assistance from anyone else, such that the cameraoperator is also the subject of the photo or video recording. At times,these self-productions can be monetized. With instructional andreality-based content, everyone is a potential producer. As such,monetization demands greater quality in the video production. However,most camera operators/producers traditionally do not have training infilmmaking to improve their production quality, without additionalresources and expense.

Therefore, there is a need for a mechanism to assist with camera shotmaking that supports single user operation.

SUMMARY OF THE INVENTION

According to one embodiment, a method comprises receiving an audiosignal via a microphone of a mobile device during video recording of asubject by a camera of the mobile device. The method also comprisesdetermining, at the mobile device, an audio level in a vicinity of thesubject based on the received audio signal, wherein the audio level isbased on sounds produced by the subject. The method further comprisesdetermining that the audio level triggers a shot adjustment state. Themethod also comprises dynamically adjusting, in response to the shotadjustment state, one or more camera parameters of the camera to altershot of the subject by the camera during the video recording. The cameraparameters relate to either zoom control, aperture, lighting, or acombination thereof. Alternatively, the method comprises detectingfacial expression of the subject; and determining that the facialexpression triggers the shot adjustment state, wherein the dynamicadjustment is further based on the detected facial expression.

According to another embodiment, an apparatus comprises at least oneprocessor, and at least one memory including computer program code forone or more computer programs, the at least one memory and the computerprogram code configured to, with the at least one processor, cause, atleast in part, the apparatus to receive an audio signal via a microphoneof a mobile device during video recording of a subject by a camera ofthe mobile device. The apparatus is also caused to determine, at themobile device, an audio level in a vicinity of the subject based on thereceived audio signal, wherein the audio level is based on soundsproduced by the subject. The apparatus is further caused to determinethat the audio level triggers a shot adjustment state. The apparatus isfurther caused to dynamically adjust, in response to the shot adjustmentstate, one or more camera parameters of the camera to alter shot of thesubject by the camera during the video recording. The camera parametersrelate to either zoom control, aperture, lighting, or a combinationthereof. Alternatively, the apparatus is further caused to detect facialexpression of the subject; and to determine that the facial expressiontriggers the shot adjustment state, wherein the dynamic adjustment isfurther based on the detected facial expression.

According to another embodiment, a system comprises a mobile deviceconfigured to receive an audio signal via a microphone of a mobiledevice during video recording of a subject by a camera of the mobiledevice; and an audio processing module configured to determine an audiolevel in a vicinity of the subject based on the received audio signal,wherein the audio level is based on sounds produced by the subject. Thesystem also comprises a facial recognition module configured to detectfacial expression of the subject; and a shot adjustment moduleconfigured to determine that the audio level or the facial expressiontriggers a shot adjustment state, and to instruct a camera controllerwithin the mobile device to dynamically adjust, in response to the shotadjustment state, one or more camera parameters of the camera to altershot of the subject by the camera during the video recording. The cameraparameters relate to either zoom control, aperture, lighting, or acombination thereof.

In addition, for various example embodiments of the invention, thefollowing is applicable: a method comprising facilitating a processingof and/or processing (1) data and/or (2) information and/or (3) at leastone signal, the (1) data and/or (2) information and/or (3) at least onesignal based, at least in part, on (or derived at least in part from)any one or any combination of methods (or processes) disclosed in thisapplication as relevant to any embodiment of the invention.

Still other aspects, features, and advantages of the invention arereadily apparent from the following detailed description, simply byillustrating a number of particular embodiments and implementations,including the best mode contemplated for carrying out the invention. Theinvention is also capable of other and different embodiments, and itsseveral details can be modified in various obvious respects, all withoutdeparting from the spirit and scope of the invention. Accordingly, thedrawings and description are to be regarded as illustrative in nature,and not as restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

The embodiments of the invention are illustrated by way of example, andnot by way of limitation, in the figures of the accompanying drawings:

FIGS. 1A and 1B are, respectively, diagrams of a mobile deviceconfigured to provide zoom level or aperture control based on audiolevel within vicinity of the subject, according to various embodiments;

FIGS. 1C and 1D are, respectively, diagrams of a mobile deviceconfigured to provide zoom level or aperture control based on facialexpressions of the subject, according to various embodiments;

FIG. 2 is a diagram of possible configurations for use of multipledevices to provide dynamic camera shot making, according to variousembodiments;

FIG. 3 is a diagram of the functional components of the mobile device ofFIGS. 1A-1D, according to one embodiment;

FIG. 4 is a diagram of a graphical user interface (GUI) for cameracontrol mode selection via the mobile device of FIGS. 1A-1D, accordingto one embodiment;

FIG. 5 is a diagram of a graphical user interface (GUI) for film modeselection via the mobile device of FIGS. 1A-1D, according to oneembodiment;

FIG. 6 is a flowchart of a process for dynamic adjustment of cameraparameters based on audio levels, according to an exemplary embodiment;

FIG. 7 is a flowchart of a process for dynamic adjustment of cameraparameters based on facial expression, according to an exemplaryembodiment;

FIG. 8 is a flowchart of a process for generating camera instructionsbased on pacing of speech, according to an exemplary embodiment;

FIG. 9 is a flowchart of a process for determining audio level frommultiple audio signal sources, according to an exemplary embodiment;

FIG. 10 is a diagram of system capable of providing dynamic adjustmentof camera shots via a video platform, according to an exemplaryembodiment;

FIG. 11 is a diagram of a chip set that can be used to implement anembodiment of the invention; and

FIG. 12 is a diagram of a mobile device (e.g., handset) that can be usedto implement an embodiment of the invention.

DESCRIPTION OF THE PREFERRED EMBODIMENT

Examples of approaches for providing segment-based viewing of awatermarked recording are disclosed. In the following description, forthe purposes of explanation, numerous specific details are set forth inorder to provide a thorough understanding of the embodiments of theinvention. It is apparent, however, to one skilled in the art that theembodiments of the invention may be practiced without these specificdetails or with an equivalent arrangement. In other instances,well-known structures and devices are shown in block diagram form inorder to avoid unnecessarily obscuring the embodiments of the invention.

FIGS. 1A and 1B are, respectively, diagrams of a mobile deviceconfigured to provide zoom level or aperture control based on audiolevel within vicinity of the subject, according to various embodiments.The popularity of self-production of video content, such as videoblogging (i.e., vlogging), stems in part because it is cost-effectiveand is an autonomous activity. Many of the creators work independently,and as such do not have camera operators to improve the quality of theirrecordings. In recognition of this problem, a process and associatedsystem are introduced to enhance video production without incurring thecost of human resources, e.g., camera operator or cinema topographer.Notably, the process imitates the choices a camera operator or cinematopographer would make in response to emotional choices that a subjectmakes while filming.

As shown in FIG. 1A, a mobile device 100, such as a smartphone, portablecomputer, or a tablet device, includes one or more cameras 101 and amicrophone 103 to capture an image and/or video recording of a subject105. In this example, one of the cameras is aimed towards the same sideas display 107, while the other one (not shown) is typically on thebackside of the mobile device 100 and aimed at the subject 105. It iscontemplated that the mobile device 100 can be turned around such thatthe camera 101 faces the subject; that is, the subject 105 can view thedisplay 107. Under both scenarios, the microphone 103 can detect audiosignals emanating in the direction of the subject 105, who can generatesounds 109 from speech or other means, such as any audible sounds fromthe vocal chords or objects (e.g., papers that can be rustled, whistles,etc.). Such sound variations can then be used as a control mechanism forthe camera 101.

By way of example, the subject 105 is acting out a scene in which adocument is been read as part of the video recording, the subject 105can zoom in by speaking softly for dramatic effect; thus, subject 105creates sound 109, which is an audio level that triggers a shotadjustment state whereby the camera 101 is instructed to zoom. Display107 consequently shows a zoomed image of the subject 105 around thefacial area. As such, the mobile device 100 effectively identifiesfacial cues and volume and pitch changes that represent emotionalchanges in the speaker 105. The shot change to a zoom shot is made tocorrespond to the emotion being displayed by the subject 105.Accordingly, the device 100 is configured to emulate filmmaking stylesas to increase the emotional intensity or impact of the shot. The degreeof zoom can be preset based on the film mode selected (this selectionprocess is detailed in FIG. 4). It is noted that two different types ofzooming may be supported by the mobile device 100: digital zoom and lenszooming. Because digital zoom can result in poorer resolution, the filmmode may limit the digital zoom level accordingly. The return to theoriginal shot can be based on when the audio level changes between arange or satisfies a threshold, or by another action by the subject. InFIG. 1B, the subject 105 can speak loudly to a point that triggers themobile device 109 to detect an elevated audio level beyond a range (orthreshold) to pan out. The wide shot is produced according to theselected film mode as to conform to a style of filmmaking.

It is noted that in addition to the zoom level, the mobile device 100enables adjustment of the aperture (not shown). Aperture pertains to theamount of light that is passed through the camera len's diaphragm,affecting depth of field and shutter speed. The camera 101 can changeaperture based on changes in volume. For instance, when the microphone103 records quieter sounds, this triggers the camera 101 to change to alarger aperture (i.e., smaller f-number), thereby blurring thebackground and focusing on the foreground. When the microphone 103 picksup louder sounds, this triggers the camera 101 to cause the aperture toget smaller, which would expand the focus to include the foreground andthe background. Medium volume can return the aperture to a standardsize, for example. Moreover, the aperture setting is based on the filmmode. It is contemplated that other camera parameters may be controlled,such as lighting, a flash (not shown) of the mobile device 100.

The shot adjustment of the mobile device 100 can also be controlleddynamically through facial expressions formed by the subject 109. Thiscapability advantageously provides for autonomous adjustment of thecamera 101 based on what the subject 105 is doing and saying, not justthe static recognition of the subject's presence.

FIGS. 1C and 1D are, respectively, diagrams of a mobile deviceconfigured to provide zoom level or aperture control based on facialexpressions of the subject, according to various embodiments. The mobiledevice 100, under this scenario, has facial recognition capabilities,whereby the facial expressions of the subject can be rendered andprocessed to determine whether the expression 111 triggers a shotadjustment state. The mobile device 100 may support a number ofdifferent predetermined expressions of the subject, such that thecaptured expression 111 is compared with these predeterminedexpressions. In this example, the subject makes an expression 111indicating shock or alarm, which is identified as corresponding to oneof the predetermined set of expressions that will trigger a zoomfunction. As such, the camera 101 is instructed to zoom to a certainzoom shot specified according to the film mode; it is noted that theview of the display 107 would be facing the subject (although forillustrative purposes, the mobile device 100 is shown in this manner).Again, the original shot mode may resume after a predetermined timeperiod, expression 111 changes to another recognized expression, or byan action of the subject 101; further these aspects may be according tothe film mode.

FIG. 1D depicts a situation whereby the mobile device 100 detects thatthe subject 105 have an expression 111 in which the subject is smiling.This expression 111 causes the camera 101 to pan out into a wide shotuntil, for example, the expression changes to one that corresponds to anoriginal shot mode.

Table 1 below illustrates some exemplary control scenarios for zoomlevel and aperture (as default settings):

TABLE 1 FILM SHOT CONTROL SCENARIOS a) Zoom based on volume: i) Louder =zoom out ii) Quieter = zoom in b) Aperture based on volume: i) Louder =bigger f value ii) Quieter = smaller f value c) Zoom based on facialrecognition: i) serious/sad expression = zoom in ii) excited/angryexpression = zoom out d) Aperture based on facial recognition: i)serious/sad expression = smaller f value ii) Excited/angry expression =larger f value e) Zoom based on motion detection: i) Stillness = zoom inii) Motion = zoom out f) Aperture based on motion detection: i)Stillness = smaller f value ii) Motion = larger f value

In addition, the user can configure the various camera parametersmanually. That is, the user can change any of the cause and effectrelationships listed in Table 1 as well as turn on/off any of thefeatures. The user can also select a range for any of the features tocustomize/personalize the settings. For instance, the various featurescan be set in the following ways, as in Table 2:

CAMERA SHOT SETTINGS  1) Zoom Speed (1) Change how quickly it zoomsin/out  2) Zoom Decibel Range (1) Can change how the camera responds tothe inputs (i.e. zoom in when speaker is louder)  3) Aperture Speed (1)Change how quickly the aperture refocuses  4) Aperture (f) number range(1) Can select how far the aperture can change  5) Primary/SecondarySubjects (1) The user can select the subjects to focus on forfilming/listening  6) Filters (1) The user can adjust camera filters tocreate different ambiance for the shots  7) Brightness  8) Day or NightSetting (1) The user can change the brightness level and the use of alight on the camera  9) Microphone Range (1) Can calibrate the softwareto the speaker's normal volume, 10) Microphone Preferences (1) If usingmultiple microphones the user can select which microphones will adjustcamera features or can use all inputs from multiple microphones

FIG. 2 is a diagram of possible configurations for use of multipledevices to provide dynamic camera shot making, according to variousembodiments. Under this scenario, multiple mobile devices 201, 203 maycommunicate to improve the accuracy of detecting the audio levels byusing two microphones 211, 213. For example, the mobile device 100,acting as the primary device, establishes communication with the mobiledevice 203, which is designated the secondary device. The communicationconnection is wireless via WiFi or Bluetooth, for instance. In this way,the audio signal captured by the microphone 213 of the secondary device203 can be transmitted to the primary device 201 for processing with theaudio signal captured by the primary device's microphone 211. If facialexpression is to be used to control the type of shot, the secondarydevice 203 may capture the expression of the subject 105 and transmitthe image to the primary device 201 to assist with facial recognition.The image, certain embodiments, is a single frame or a pre-determinednumber of frames for effective processing. Because the devices 201, 203may be capturing the subject 105 from different angles, such diversityimproves accuracy of the facial expression detection.

Alternatively or additionally, the mobile device 201 may instead connectwirelessly to a peripheral device 205 that has audio capture capability,such as a standalone microphone or a speaker with a microphone.Accordingly, the peripheral device 205 may be placed closer to thesubject 105 to more accurately record any sounds or utterances from thesubject 105. Through proper placement of the devices 201, 205, thesubject 105 who is speaking (assuming there are multiple people in theshot) and then isolate the sound from the closest microphone, e.g.,device 205. As such, the microphones can be configured to directionallyrecord, such that variable sound recording levels can be controlled toincrease or decrease to provide greater isolation. This can moreaccurately determine camera angle, zoom, aperture, and lightingproportionality by isolating the location of the speaker and picking upthe sound as cleanly as possible.

Under the scenario in which multiple mobile devices 201, 203 areutilized, a combination of facial recognition, sound direction/distance,and body movements, the cameras 211, 213 capture various angles of agiven subject 105 or area based on changes in the speaker's face andvoice. In one embodiment, the additional camera can be in form of adrone, whereby the done in the air flying around the subject 105 canautomatically adjust its relative position to obtain a high angle shot,face level shot, and lower angle shot. Proportionally, presets can helpdetermine distance, angle, sound levels, and zoom. Additionally, a usercan customize all of these same elements as well as adjust speed, paceof angles, etc.

FIG. 3 is a diagram of the functional components of the mobile device ofFIGS. 1A-1D, according to one embodiment. To accomplish the variousfunctions described herein, the mobile device 100 (of FIGS. 1A-1D)includes an audio processing module 301, a speech processor 303, a filmmode selection module 305, a shot adjustment module 307, a cameracontroller 309, a facial recognition module 311, and a wirelesscommunication module 313. Although indicated as modules, thesecomponents 301-313 may be implemented in a combination of hardware andsoftware to enable dynamic adjustment of camera shots. Specifically, theaudio processing module 301 receives one or more audio signals from themicrophone 103 to determine the audio level. To accomplish this, theaudio processing module 301 may apply various audio filters to ensurethe captured audio signals emanate from the proximity of the subject.The module 301 may also calibrate the audio level based on the ambiencenoise level; for example, if the shot is been taken within an urbansetting, perhaps the sounds of traffic can be mitigated. The audiosignals are input to the speech processor 303 to detect whetherintelligible speech can be discern from the subject 105. As will beexplained later, the speech processor 303 can additionally determine thepacing or cadence of the speech.

As shown, the film mode selection module 305 allows a user to select theparticular filming styles, which effectively provides defaultconfiguration settings for the camera parameters to implement theselected film mode. The film mode selection module 305 can supportvarious film modes, e.g.: sports/action, slow motion, extreme close-up,indie film, documentary, extreme pan, film noir, monologue, video blog(vlog) monologue, or customized. These modes can be presented forselection by the user using a graphical user interface (GUI), as thatshown in FIG. 5. Once the user inputs a selection, the shot adjustmentmodule 307 instructs the camera controller 309 accordingly to produceshots according to camera control settings corresponding to the selectedfilm mode.

The mobile device 100 additional has a facial recognition module 311 tocapture the facial expression of the subject 105 for processing todetermine the type of expression the subject 105 is emoting. Further,the facial recognition module 311 employs state of the art facial andeye retina technology. Once the expression is determined by the module311 in conjunction with the shot adjustment module 307, the shotadjustment module 307 generates control instructions to the cameracontroller 309 specifying the camera parameters, e.g., zoom control,aperture, lighting, or a combination thereof.

To support a multi-device arrangement of FIG. 2, the mobile device 100includes wireless communication module 313 to communicate with anothermobile device or a peripheral device. Such communication, for instance,can be via wireless networking technology (e.g., WiFi, etc.) orshort-range wireless communication technology (e.g., near-fieldcommunications (NFC), Bluetooth, ZigBee, infrared transmission, etc.).

FIG. 4 is a diagram of a graphical user interface (GUI) for cameracontrol mode selection via the mobile device of FIGS. 1A-1D, accordingto one embodiment. As evident from the exemplary scenarios of FIGS.1A-1D, dynamic adjustment of camera shots can be triggered based onaudio levels and/or facial expressions. Thus, the mobile device 100provides for designation of these various control modes. As shown, GUI401 includes the following three sections to enable input by the user:an audio level control mode 403, a facial control mode 405, and an audiolevel and facial control mode 407. With the audio level control mode403, the device 100 is strictly controlling camera shots based on theaudio level associated with the subject 105 (as in FIGS. 1A and 1B).Alternatively, the facial control mode 405 permits control of thefilming by the detected expressions of the subject 105; such mode may bepreferred in a setting in which the noise level must be kept to aminimum, such as a library or a church. Additionally, the mobile device100 supports the capability to adjust film shots using both audio levelsand facial expressions.

This capability to dynamically adjust film shots could be utilized in anumber of media fields. These fields may include television, musicvideos, films, as well as individual filming. By way of example, thedynamic shot making capability has tremendous application in wildlifemanagement; e.g., placing cameras placed in the field would zoom in onsources of sound they could be more effective at finding animals. Manyother applications are contemplated depending on the subject matter,e.g., a musician self-filming a music video.

FIG. 5 is a diagram of a graphical user interface (GUI) for film modeselection via the mobile device of FIGS. 1A-1D, according to oneembodiment. In this example, the mobile device 100 provides a GUI 501 toallow a user to select a particular film mode, such that the cameraparameters are pre-set or pre-configured according to the selected filmmode. That is, film modes or styles dictate when and how and at whatdegree of zooming levels are used; the aperture settings and/or flashcontrol may be set accordingly as well. By way of example, the followingfilm modes are provided: a sports/action mode 503, a slow motion mode505, an extreme close-up mode 507, an indie film mode 509, a documentarymode 511, an extreme pan mode 513, a film noir mode 515, a monologuemode 517, a video blog (vlog) monologue mode 519, or a customized mode521.

Details of certain film modes are described as follows for the purposesof illustration. With the sports/action mode 503, zoom range is largeand changes quickly, f value is large and does not change; the zoomingand aperture are triggered by changes in motion and volume, notemotional facial recognition. Also, the sports/action mode 503 can havefilters to provide high contrast, vibrancy, and saturation. In theextreme close-up mode 507, for example, zoom range is minimal, and fvalue is small and does not change; these parameters are triggered bychanges in voice and emotional facial recognition, and not motion. Forindie film mode 509, the zoom range is minimal, and f value varies basedon input; the changes in shots are primarily by emotional facialrecognition, and the filter is marked by Low saturation and clarity.With film noir mode 515, the zoom range is moderate, and f value variesbased on input; adjustment is triggered by voice, face, and movement. Inthe case of the monologue mode 517, the zoom range is moderate, and fvalue is small and does not change; adjustment is triggered by voice,face, and movement. The other film mode have different characteristics.

With customized mode 521, the user can pre-select the following elementsprior to filming: (1) subjects/objects within scene; (2)primary/secondary subjects/angles (when employing multiple cameras); (3)angle preferences; (4) camera priorities (e.g., in FIG. 2, camera 211follows subject 105). Based on these preferences, users can select howthey want to film a scene and the stylistic elements to be included;e.g., talking scene between subject (A) and subject (B) can have a levelangle and low angle. Upon subject (A) speaking, a secondary camera canperform a dolly zoom at a level angle while also focused on subject (B).Simultaneously, primary camera (high angle) can shoot a wide angle shoton subject (A).

It is contemplated that other film modes can be supported; e.g., a modecan be developed to be in the style of a renowned director orcinematographer.

FIG. 6 is a flowchart of a process for dynamic adjustment of cameraparameters based on audio levels, according to an exemplary embodiment.Continuing with the example of FIGS. 1A-1D and FIG. 2, the mobile device100 can execute process 600, which provides camera shot adjustmentsdynamically. In step 601, an audio signal is received via a microphone103 of the mobile device 100 during video recording of the subject 105by the camera 101 of the mobile device 100. The audio signal representsthe sounds around the subject 105 or emanating from the subject 105either as speech or other utterances or sounds. The audio signal isprocessed by the audio processing module 301 and the speech processor303 to determine, as in step 603, the audio level in a vicinity of thesubject 105 based on the received audio signal. Again, as explained, theaudio level is based on sounds produced by the subject 105 and othersurrounding sounds, which can be filtered out by the audio processingmodule 301. In step 605, the shot adjustment module 307 determines thatthe audio level triggers a shot adjustment state. This trigger can bebased on a predetermined threshold level (e.g., expressed in decibels)or range of levels, as set by the film mode. In step 607, the shotadjustment module 307 instructs the camera controller 309 to dynamicallyadjust, in response to the shot adjustment state, one or more cameraparameters of the camera 101 to alter shot of the subject 105 by thecamera 101 during the video recording. The dynamic adjustment stems fromthe fact that the camera control is occurring during the video recordingversus modification of the video recording during editing orpost-production. In one embodiment, the camera parameters relate toeither zoom control, aperture, lighting, or a combination thereof.

FIG. 7 is a flowchart of a process for dynamic adjustment of cameraparameters based on facial expression, according to an exemplaryembodiment. Alternatively, the mobile device 100 can execute process700, and detect facial expression of the subject 105 using the facialrecognition module 311 (step 701); and determine, via that shotadjustment module 307, that the facial expression triggers the shotadjustment state, per step 703. As noted earlier, adjustment via facialexpression can be an additional (as well as alternative) featureoverlaid onto the audio level. Under this scenario, the dynamicadjustment using facial expressions is an additional feature; and thus,the dynamic adjustment is further based on the detected facialexpression, per step 705.

FIG. 8 is a flowchart of a process for generating camera instructionsbased on pacing of speech, according to an exemplary embodiment. Underthis scenario, the mobile device 100 executes process 800 by utilizingthe speech processor 303 (of FIG. 3) to detect speech of the subject105, as in step 801. Next, the speech processor 303 determines pace orcadence of the speech from the subject 105, per step 803. The shotadjustment module 307 then, per step 805, generates a camera instructionmessage to change zoom level or aperture setting of the camera 101 basedon the determined pace of the speech. It is contemplated that theprocess 800 can be executed as a complement to the processes 600 and700.

Two scenarios are described for the purposes of illustration. Thesubject 105 speaks fast and then changes the rate of speech to a muchslower pace. This change can result in the camera zooming in closer aswell as the aperture getting larger (i.e., smaller f-number). If thesubject 105 increases the pace or rate of words then the camera zoomsout and the aperture is set to a smaller value (i.e., larger f-number).

In the next scenario, the subject 105 has playing music in the shot, andthe pace of the music speeds up. This can cause the camera 101 to zoomout as well as the aperture setting being reduced (i.e., largerf-number). Alternatively, if the pace or speed of the music slows downthen the camera 101 would zoom in and the aperture would get larger(smaller f-number).

FIG. 9 is a flowchart of a process for determining audio level frommultiple audio signal sources, according to an exemplary embodiment.Process 900 is described according to the example of FIG. 2. The mobiledevice 201 is designated as a primary device, and detects the presenceof a second device, which is either the mobile device 203 or theperipheral device 205, as in step 901. By way of example, the secondarydevice is the mobile device 203. In step 903, the primary device201establishes communication with the mobile device 203, which isdesignated the secondary device. The communication connection iswireless via WiFi or Bluetooth, for instance. During the video recordingof the subject 105 by the primary device 201, the secondary device 203is also concurrently recording the subject 105. The audio signalcaptured by the microphone 213 of the secondary device 203 during suchrecording can be transmitted to the primary device 201 for processing.In step 905, the primary device 201 receives the secondary audio signalfrom the second device 203, and determines the audio level using theprimary audio signal and the secondary audio signal.

Although the process 900 is described with respect to the audio levelbased control, it is noted that use of the mobile device 203 can greatlyimprove the facial expression based control. That is, because thedevices 201, 203 can be strategically placed to capture the face of thesubject 105 from different angles, greater accuracy of the facialexpression detection can be achieved. It is also contemplated that thetwo devices 201, 203 can concurrently use its respective facialrecognition modules to detect the expression, whereby the first deviceto detect the expression will prevail. In other words, if the secondarydevice 203 completes the detection first, the device 203 can forwardsuch information to the primary device 201. This capability isadvantageous if the secondary device 203 has greater processing powerthan the primary device 201.

The processes described herein for dynamic shot adjustment may beadvantageously implemented via software, hardware (e.g., generalprocessor, Digital Signal Processing (DSP) chip, an Application SpecificIntegrated Circuit (ASIC), Field Programmable Gate Arrays (FPGAs),etc.), firmware or a combination thereof. Such exemplary hardware forperforming the described functions is detailed below.

FIG. 10 illustrates a computer system 1000 upon which an embodiment ofthe invention may be implemented. Although computer system 1000 isdepicted with respect to a particular device or equipment, it iscontemplated that other devices or equipment (e.g., network elements,servers, etc.) within FIG. 10 can deploy the illustrated hardware andcomponents of system 1000. Computer system 1000 is programmed (e.g., viacomputer program code or instructions) to dynamically adjust cameraparameters to alter film shots as described herein and includes acommunication mechanism such as a bus 1010 for passing informationbetween other internal and external components of the computer system1000. Information (also called data) is represented as a physicalexpression of a measurable phenomenon, typically electric voltages, butincluding, in other embodiments, such phenomena as magnetic,electromagnetic, pressure, chemical, biological, molecular, atomic,sub-atomic and quantum interactions. For example, north and southmagnetic fields, or a zero and non-zero electric voltage, represent twostates (0, 1) of a binary digit (bit). Other phenomena can representdigits of a higher base. A superposition of multiple simultaneousquantum states before measurement represents a quantum bit (qubit). Asequence of one or more digits constitutes digital data that is used torepresent a number or code for a character. In some embodiments,information called analog data is represented by a near continuum ofmeasurable values within a particular range. Computer system 1000, or aportion thereof, constitutes a means for performing one or more steps ofa segment-based viewing of a watermarked recording.

A bus 1010 includes one or more parallel conductors of information sothat information is transferred quickly among devices coupled to the bus1010. One or more processors 1002 for processing information are coupledwith the bus 1010.

A processor (or multiple processors) 1002 performs a set of operationson information as specified by computer program code related to asegment-based viewing of a watermarked recording. The computer programcode is a set of instructions or statements providing instructions forthe operation of the processor and/or the computer system to performspecified functions. The code, for example, may be written in a computerprogramming language that is compiled into a native instruction set ofthe processor. The code may also be written directly using the nativeinstruction set (e.g., machine language). The set of operations includebringing information in from the bus 1010 and placing information on thebus 1010. The set of operations also typically include comparing two ormore units of information, shifting positions of units of information,and combining two or more units of information, such as by addition ormultiplication or logical operations like OR, exclusive OR (XOR), andAND. Each operation of the set of operations that can be performed bythe processor is represented to the processor by information calledinstructions, such as an operation code of one or more digits. Asequence of operations to be executed by the processor 1002, such as asequence of operation codes, constitute processor instructions, alsocalled computer system instructions or, simply, computer instructions.Processors may be implemented as mechanical, electrical, magnetic,optical, chemical, or quantum components, among others, alone or incombination.

Computer system 1000 also includes a memory 1004 coupled to bus 1010.The memory 1004, such as a random access memory (RAM) or any otherdynamic storage device, stores information including processorinstructions for a segment-based viewing of a watermarked recording.Dynamic memory allows information stored therein to be changed by thecomputer system 1000. RAM allows a unit of information stored at alocation called a memory address to be stored and retrievedindependently of information at neighboring addresses. The memory 1004is also used by the processor 1002 to store temporary values duringexecution of processor instructions. The computer system 1000 alsoincludes a read only memory (ROM) 1006 or any other static storagedevice coupled to the bus 1010 for storing static information, includinginstructions, that is not changed by the computer system 1000. Somememory is composed of volatile storage that loses the information storedthereon when power is lost. Also coupled to bus 1010 is a non-volatile(persistent) storage device 1008, such as a magnetic disk, optical diskor flash card, for storing information, including instructions, thatpersists even when the computer system 1000 is turned off or otherwiseloses power.

Information, including instructions for a segment-based viewing of awatermarked recording, is provided to the bus 1010 for use by theprocessor from an external input device 1002, such as a keyboardcontaining alphanumeric keys operated by a human user, a microphone, anInfrared (IR) remote control, a joystick, a game pad, a stylus pen, atouch screen, or a sensor. A sensor detects conditions in its vicinityand transforms those detections into physical expression compatible withthe measurable phenomenon used to represent information in computersystem 1000. Other external devices coupled to bus 1010, used primarilyfor interacting with humans, include a display device 1004, such as acathode ray tube (CRT), a liquid crystal display (LCD), a light emittingdiode (LED) display, an organic LED (OLED) display, a plasma screen, ora printer for presenting text or images, and a pointing device 1006,such as a mouse, a trackball, cursor direction keys, or a motion sensor,for controlling a position of a small cursor image presented on thedisplay 1014 and issuing commands associated with graphical elementspresented on the display 1014, and one or more camera sensors 1094 forcapturing, recording and causing to store one or more still and/ormoving images (e.g., videos, movies, etc.) which also may comprise audiorecordings. In some embodiments, for example, in embodiments in whichthe computer system 1000 performs all functions automatically withouthuman input, one or more of external input device 1002, display device1004 and pointing device 1006 may be omitted.

In the illustrated embodiment, special purpose hardware, such as anapplication specific integrated circuit (ASIC) 1020, is coupled to bus1010. The special purpose hardware is configured to perform operationsnot performed by processor 1002 quickly enough for special purposes.Examples of ASICs include graphics accelerator cards for generatingimages for display 1014, cryptographic boards for encrypting anddecrypting messages sent over a network, speech recognition, andinterfaces to special external devices, such as robotic arms and medicalscanning equipment that repeatedly perform some complex sequence ofoperations that are more efficiently implemented in hardware.

Computer system 1000 also includes one or more instances of acommunications interface 1070 coupled to bus 1010. Communicationinterface 1070 provides a one-way or two-way communication coupling to avariety of external devices that operate with their own processors, suchas printers, scanners and external disks. In general the coupling iswith a network link 1078 that is connected to a local network 1080 towhich a variety of external devices with their own processors areconnected. For example, communication interface 1070 may be a parallelport or a serial port or a universal serial bus (USB) port on a personalcomputer. In some embodiments, communications interface 1070 is anintegrated services digital network (ISDN) card or a digital subscriberline (DSL) card or a telephone modem that provides an informationcommunication connection to a corresponding type of telephone line. Insome embodiments, a communication interface 1070 is a cable modem thatconverts signals on bus 1010 into signals for a communication connectionover a coaxial cable or into optical signals for a communicationconnection over a fiber optic cable. As another example, communicationsinterface 1070 may be a local area network (LAN) card to provide a datacommunication connection to a compatible LAN, such as Ethernet. Wirelesslinks may also be implemented. For wireless links, the communicationsinterface 1070 sends or receives or both sends and receives electrical,acoustic or electromagnetic signals, including infrared and opticalsignals, that carry information streams, such as digital data. Forexample, in wireless handheld devices, such as mobile telephones likecell phones, the communications interface 1070 includes a radio bandelectromagnetic transmitter and receiver called a radio transceiver. Incertain embodiments, the communications interface 1070 enablesconnection to the telephony network 107 for a segment-based viewing of awatermarked recording to the user equipment 103.

The term “computer-readable medium” as used herein refers to any mediumthat participates in providing information to processor 1002, includinginstructions for execution. Such a medium may take many forms,including, but not limited to computer-readable storage medium (e.g.,non-volatile media, volatile media), and transmission media.Non-transitory media, such as non-volatile media, include, for example,optical or magnetic disks, such as storage device 1008. Volatile mediainclude, for example, dynamic memory 1004. Transmission media include,for example, twisted pair cables, coaxial cables, copper wire, fiberoptic cables, and carrier waves that travel through space without wiresor cables, such as acoustic waves and electromagnetic waves, includingradio, optical and infrared waves. Signals include man-made transientvariations in amplitude, frequency, phase, polarization or otherphysical properties transmitted through the transmission media. Commonforms of computer-readable media include, for example, a floppy disk, aflexible disk, hard disk, magnetic tape, any other magnetic medium, aCD-ROM, CDRW, DVD, any other optical medium, punch cards, paper tape,optical mark sheets, any other physical medium with patterns of holes orother optically recognizable indicia, a RAM, a PROM, an EPROM, aFLASH-EPROM, an EEPROM, a flash memory, any other memory chip orcartridge, a carrier wave, or any other medium from which a computer canread. The term computer-readable storage medium is used herein to referto any computer-readable medium except transmission media.

Logic encoded in one or more tangible media includes one or both ofprocessor instructions on a computer-readable storage media and specialpurpose hardware, such as ASIC 1020.

Network link 1078 typically provides information communication usingtransmission media through one or more networks to other devices thatuse or process the information. For example, network link 1078 mayprovide a connection through local network 1080 to a host computer 1082or to equipment 1084 operated by an Internet Service Provider (ISP). ISPequipment 1084 in turn provides data communication services through thepublic, world-wide packet-switching communication network of networksnow commonly referred to as the Internet 1090.

A computer called a server host 1092 connected to the Internet hosts aprocess that provides a service in response to information received overthe Internet. For example, server host 1092 hosts a process thatprovides information representing video data for presentation at display1014. It is contemplated that the components of system 1000 can bedeployed in various configurations within other computer systems, e.g.,host 1082 and server 1092.

At least some embodiments of the invention are related to the use ofcomputer system 1000 for implementing some or all of the techniquesdescribed herein. According to one embodiment of the invention, thosetechniques are performed by computer system 1000 in response toprocessor 1002 executing one or more sequences of one or more processorinstructions contained in memory 1004. Such instructions, also calledcomputer instructions, software and program code, may be read intomemory 1004 from another computer-readable medium such as storage device1008 or network link 1078. Execution of the sequences of instructionscontained in memory 1004 causes processor 1002 to perform one or more ofthe method steps described herein. In alternative embodiments, hardware,such as ASIC 1020, may be used in place of or in combination withsoftware to implement the invention. Thus, embodiments of the inventionare not limited to any specific combination of hardware and software,unless otherwise explicitly stated herein.

The signals transmitted over network link 1078 and other networksthrough communications interface 1070, carry information to and fromcomputer system 1000. Computer system 1000 can send and receiveinformation, including program code, through the networks 1080, 1090among others, through network link 1078 and communications interface1070. In an example using the Internet 1090, a server host 1092transmits program code for a particular application, requested by amessage sent from computer 1000, through Internet 1090, ISP equipment1084, local network 1080 and communications interface 1070. The receivedcode may be executed by processor 1002 as it is received, or may bestored in memory 1004 or in storage device 1008 or any othernon-volatile storage for later execution, or both. In this manner,computer system 1000 may obtain application program code in the form ofsignals on a carrier wave.

Various forms of computer readable media may be involved in carrying oneor more sequence of instructions or data or both to processor 1002 forexecution. For example, instructions and data may initially be carriedon a magnetic disk of a remote computer such as host 1082. The remotecomputer loads the instructions and data into its dynamic memory andsends the instructions and data over a telephone line using a modem. Amodem local to the computer system 1000 receives the instructions anddata on a telephone line and uses an infra-red transmitter to convertthe instructions and data to a signal on an infra-red carrier waveserving as the network link 1078. An infrared detector serving ascommunications interface 1070 receives the instructions and data carriedin the infrared signal and places information representing theinstructions and data onto bus 1010. Bus 1010 carries the information tomemory 1004 from which processor 1002 retrieves and executes theinstructions using some of the data sent with the instructions. Theinstructions and data received in memory 1004 may optionally be storedon storage device 1008, either before or after execution by theprocessor 1002.

FIG. 11 illustrates a chip set or chip 1100 upon which an embodiment ofthe invention may be implemented. Chip set 1100 is programmed todynamically adjust camera parameters to alter film shots as describedherein and includes, for instance, the processor and memory componentsdescribed with respect to FIG. 11 incorporated in one or more physicalpackages (e.g., chips). By way of example, a physical package includesan arrangement of one or more materials, components, and/or wires on astructural assembly (e.g., a baseboard) to provide one or morecharacteristics such as physical strength, conservation of size, and/orlimitation of electrical interaction. It is contemplated that in certainembodiments the chip set 1100 can be implemented in a single chip. It isfurther contemplated that in certain embodiments the chip set or chip1100 can be implemented as a single “system on a chip.” It is furthercontemplated that in certain embodiments a separate ASIC would not beused, for example, and that all relevant functions as disclosed hereinwould be performed by a processor or processors. Chip set or chip 1100,or a portion thereof, constitutes a means for performing one or moresteps of providing user interface navigation information associated withthe availability of functions. Chip set or chip 1100, or a portionthereof, constitutes a means for performing one or more steps ofsegment-based viewing of a watermarked recording.

In one embodiment, the chip set or chip 1100 includes a communicationmechanism such as a bus 1101 for passing information among thecomponents of the chip set 1100. A processor 1103 has connectivity tothe bus 1101 to execute instructions and process information stored in,for example, a memory 1105. The processor 1103 may include one or moreprocessing cores with each core configured to perform independently. Amulti-core processor enables multiprocessing within a single physicalpackage. Examples of a multi-core processor include two, four, eight, orgreater numbers of processing cores. Alternatively or in addition, theprocessor 1103 may include one or more microprocessors configured intandem via the bus 1101 to enable independent execution of instructions,pipelining, and multithreading. The processor 1103 may also beaccompanied with one or more specialized components to perform certainprocessing functions and tasks such as one or more digital signalprocessors (DSP) 1107, or one or more application-specific integratedcircuits (ASIC) 1109. A DSP 1107 typically is configured to processreal-world signals (e.g., sound) in real time independently of theprocessor 1103. Similarly, an ASIC 1109 can be configured to performedspecialized functions not easily performed by a more general purposeprocessor. Other specialized components to aid in performing theinventive functions described herein may include one or more fieldprogrammable gate arrays (FPGA), one or more controllers, or one or moreother special-purpose computer chips.

In one embodiment, the chip set or chip 1100 includes merely one or moreprocessors and some software and/or firmware supporting and/or relatingto and/or for the one or more processors.

The processor 1103 and accompanying components have connectivity to thememory 1105 via the bus 1101. The memory 1105 includes both dynamicmemory (e.g., RAM, magnetic disk, writable optical disk, etc.) andstatic memory (e.g., ROM, CD-ROM, etc.) for storing executableinstructions that when executed perform the inventive steps describedherein to a segment-based viewing of a watermarked recording. The memory1105 also stores the data associated with or generated by the executionof the inventive steps.

FIG. 12 is a diagram of exemplary components of a mobile device (e.g.,handset) for communications, which is capable of operating in the systemof FIG. 1, according to one embodiment. In some embodiments, mobiledevice 1201, or a portion thereof, constitutes a means for dynamicadjustment of camera parameters. Generally, a radio receiver is oftendefined in terms of front-end and back-end characteristics. Thefront-end of the receiver encompasses all of the Radio Frequency (RF)circuitry whereas the back-end encompasses all of the base-bandprocessing circuitry. As used in this application, the term “circuitry”refers to both: (1) hardware-only implementations (such asimplementations in only analog and/or digital circuitry), and (2) tocombinations of circuitry and software (and/or firmware) (such as, ifapplicable to the particular context, to a combination of processor(s),including digital signal processor(s), software, and memory(ies) thatwork together to cause an apparatus, such as a mobile phone or server,to perform various functions). This definition of “circuitry” applies toall uses of this term in this application, including in any claims. As afurther example, as used in this application and if applicable to theparticular context, the term “circuitry” would also cover animplementation of merely a processor (or multiple processors) and its(or their) accompanying software/or firmware. The term “circuitry” wouldalso cover if applicable to the particular context, for example, abaseband integrated circuit or applications processor integrated circuitin a mobile phone or a similar integrated circuit in a cellular networkdevice or other network devices.

Pertinent internal components of the telephone include a Main ControlUnit (MCU) 1203, a Digital Signal Processor (DSP) 1205, and areceiver/transmitter unit including a microphone gain control unit and aspeaker gain control unit. A main display unit 1207 provides a displayto the user in support of various applications and mobile devicefunctions that perform or support the steps of segment-based viewing ofa watermarked recording. The display 1207 includes display circuitryconfigured to display at least a portion of a user interface of themobile device (e.g., mobile telephone). Additionally, the display 1207and display circuitry are configured to facilitate user control of atleast some functions of the mobile device. An audio function circuitry1209 includes a microphone 1211 and microphone amplifier that amplifiesthe speech signal output from the microphone 1211. The amplified speechsignal output from the microphone 1211 is fed to a coder/decoder (CODEC)1213.

A radio section 1215 amplifies power and converts frequency in order tocommunicate with a base station, which is included in a mobilecommunication system, via antenna 1217. The power amplifier (PA) 1219and the transmitter/modulation circuitry are operationally responsive tothe MCU 1203, with an output from the PA 1219 coupled to the duplexer1221 or circulator or antenna switch, as known in the art. The PA 1219also couples to a battery interface and power control unit 1220.

In use, a user of mobile device 1201 speaks into the microphone 1211 andhis or her voice along with any detected background noise is convertedinto an analog voltage. The analog voltage is then converted into adigital signal through the Analog to Digital Converter (ADC) 1223. Thecontrol unit 1203 routes the digital signal into the DSP 1205 forprocessing therein, such as speech encoding, channel encoding,encrypting, and interleaving. In one embodiment, the processed voicesignals are encoded, by units not separately shown, using a cellulartransmission protocol such as enhanced data rates for global evolution(EDGE), general packet radio service (GPRS), global system for mobilecommunications (GSM), Internet protocol multimedia subsystem (IMS),universal mobile telecommunications system (UMTS), etc., as well as anyother suitable wireless medium, e.g., microwave access (WiMAX), LongTerm Evolution (LTE) networks, code division multiple access (CDMA),wideband code division multiple access (WCDMA), wireless fidelity(WiFi), satellite, and the like, or any combination thereof.

The encoded signals are then routed to an equalizer 1225 forcompensation of any frequency-dependent impairments that occur duringtransmission though the air such as phase and amplitude distortion.After equalizing the bit stream, the modulator 1227 combines the signalwith a RF signal generated in the RF interface 1229. The modulator 1227generates a sine wave by way of frequency or phase modulation. In orderto prepare the signal for transmission, an up-converter 1231 combinesthe sine wave output from the modulator 1227 with another sine wavegenerated by a synthesizer 1233 to achieve the desired frequency oftransmission. The signal is then sent through a PA 1219 to increase thesignal to an appropriate power level. In practical systems, the PA 1219acts as a variable gain amplifier whose gain is controlled by the DSP1205 from information received from a network base station. The signalis then filtered within the duplexer 1221 and optionally sent to anantenna coupler 1235 to match impedances to provide maximum powertransfer. Finally, the signal is transmitted via antenna 1217 to a localbase station. An automatic gain control (AGC) can be supplied to controlthe gain of the final stages of the receiver. The signals may beforwarded from there to a remote telephone which may be another cellulartelephone, any other mobile phone or a land-line connected to a PublicSwitched Telephone Network (PSTN), or other telephony networks.

Voice signals transmitted to the mobile device 1201 are received viaantenna 1217 and immediately amplified by a low noise amplifier (LNA)1237. A down-converter 1239 lowers the carrier frequency while thedemodulator 1241 strips away the RF leaving only a digital bit stream.The signal then goes through the equalizer 1225 and is processed by theDSP 1205. A Digital to Analog Converter (DAC) 1243 converts the signaland the resulting output is transmitted to the user through the speaker1245, all under control of a Main Control Unit (MCU) 1203 which can beimplemented as a Central Processing Unit (CPU).

The MCU 1203 receives various signals including input signals from thekeyboard 1247. The keyboard 1247 and/or the MCU 1203 in combination withother user input components (e.g., the microphone 1211) comprise a userinterface circuitry for managing user input. The MCU 1203 runs a userinterface software to facilitate user control of at least some functionsof the mobile device 1201 to a segment-based viewing of a watermarkedrecording. The MCU 1203 also delivers a display command and a switchcommand to the display 1207 and to the speech output switchingcontroller, respectively. Further, the MCU 1203 exchanges informationwith the DSP 1205 and can access an optionally incorporated SIM card1249 and a memory 1251. In addition, the MCU 1203 executes variouscontrol functions required of the terminal. The DSP 1205 may, dependingupon the implementation, perform any of a variety of conventionaldigital processing functions on the voice signals. Additionally, DSP1205 determines the background noise level of the local environment fromthe signals detected by microphone 1211 and sets the gain of microphone1211 to a level selected to compensate for the natural tendency of theuser of the mobile device 1201.

The CODEC 1213 includes the ADC 1223 and DAC 1243. The memory 1251stores various data including call incoming tone data and is capable ofstoring other data including music data received via, e.g., the globalInternet. The software module could reside in RAM memory, flash memory,registers, or any other form of writable storage medium known in theart. The memory device 1251 may be, but not limited to, a single memory,CD, DVD, ROM, RAM, EEPROM, optical storage, magnetic disk storage, flashmemory storage, or any other non-volatile storage medium capable ofstoring digital data.

An optionally incorporated SIM card 1249 carries, for instance,important information, such as the cellular phone number, the carriersupplying service, subscription details, and security information. TheSIM card 1249 serves primarily to identify the mobile device 1201 on aradio network. The card 1249 also contains a memory for storing apersonal telephone number registry, text messages, and user specificmobile device settings.

Further, one or more camera sensors 1253 may be incorporated onto themobile device 1201 wherein the one or more camera sensors may be placedat one or more locations on the mobile device. Generally, the camerasensors may be utilized to capture, record, and cause to store one ormore still and/or moving images (e.g., videos, movies, etc.) which alsomay comprise audio recordings.

While the invention has been described in connection with a number ofembodiments and implementations, the invention is not so limited butcovers various obvious modifications and equivalent arrangements, whichfall within the purview of the appended claims. Although features of theinvention are expressed in certain combinations among the claims, it iscontemplated that these features can be arranged in any combination andorder.

Accordingly, an approach is disclosed for providing segment-basedviewing of a watermarked recording.

While certain exemplary embodiments and implementations have beendescribed herein, other embodiments and modifications will be apparentfrom this description. Accordingly, the invention is not limited to suchembodiments, but rather to the broader scope of the presented claims andvarious obvious modifications and equivalent arrangements.

What is claimed is:
 1. A method comprising: receiving an audio signalvia a microphone of a mobile device during video recording of a subjectby a camera of the mobile device; determining, at the mobile device, anaudio level in a vicinity of the subject based on the received audiosignal, wherein the audio level is based on sounds produced by thesubject; determining that the audio level triggers a shot adjustmentstate; and dynamically adjusting, in response to the shot adjustmentstate, one or more camera parameters of the camera to alter shot of thesubject by the camera during the video recording, wherein the cameraparameters relate to either zoom control, aperture, lighting, or acombination thereof.
 2. The method of claim 1, further comprising:establishing a wireless connection with another mobile device having amicrophone configured to generate a second audio signal during the videorecording by the mobile device; and receiving, by the mobile device, asecond audio signal from the other mobile device, wherein thedetermination of the audio level is further based on the second audiosignal.
 3. The method of claim 1, wherein the other mobile deviceincludes a camera, the method further comprising: generating a camerainstruction message to control the camera of the other mobile deviceaccording to the determined shot adjustment state.
 4. The method ofclaim 1, further comprising: detecting facial expression of the subject;and determining that the facial expression triggers the shot adjustmentstate, wherein the dynamic adjustment is further based on the detectedfacial expression.
 5. The method of claim 1, further comprising:selecting one of a plurality of film modes that specify pre-set settingsfor the parameters, wherein the dynamic adjustment is based on theselected film mode.
 6. The method of claim 1, further comprising:detecting change in the audio level outside a predetermined range; andgenerating a camera instruction message to change zoom level or aperturesetting of the camera based on the detected change.
 7. The method ofclaim 1, further comprising: detecting speech of the subject;determining pace of the speech; and generating a camera instructionmessage to change zoom level or aperture setting of the camera based onthe determined pace of the speech.
 8. An apparatus comprising: at leastone processor; and at least one memory including computer program codefor one or more programs, the at least one memory and the computerprogram code configured to, with the at least one processor, cause theapparatus to perform at least the following, receive an audio signal viaa microphone of a mobile device during video recording of a subject by acamera of the mobile device; determine, at the mobile device, an audiolevel in a vicinity of the subject based on the received audio signal,wherein the audio level is based on sounds produced by the subject;determine that the audio level triggers a shot adjustment state; anddynamically adjust, in response to the shot adjustment state, one ormore camera parameters of the camera to alter shot of the subject by thecamera during the video recording, wherein the camera parameters relateto either zoom control, aperture, lighting, or a combination thereof. 9.The apparatus of claim 8, wherein the apparatus is further caused to:establish a wireless connection with another mobile device having amicrophone configured to generate a second audio signal during the videorecording by the mobile device; and receive, by the mobile device, asecond audio signal from the other mobile device, wherein thedetermination of the audio level is further based on the second audiosignal.
 10. The apparatus of claim 8, wherein the other mobile deviceincludes a camera, the apparatus being further caused to: generate acamera instruction message to control the camera of the other mobiledevice according to the determined shot adjustment state.
 11. Theapparatus of claim 8, wherein the apparatus is further caused to: detectfacial expression of the subject; and determine that the facialexpression triggers the shot adjustment state, wherein the dynamicadjustment is further based on the detected facial expression.
 12. Theapparatus of claim 8, wherein the apparatus is further caused to: selectone of a plurality of film modes that specify pre-set settings for theparameters, wherein the dynamic adjustment is based on the selected filmmode.
 13. The apparatus of claim 8, wherein the apparatus is furthercaused to: detect change in the audio level outside a predeterminedrange; and generate a camera instruction message to change zoom level oraperture setting of the camera based on the detected change.
 14. Theapparatus of claim 8, wherein the apparatus is further caused to: detectspeech of the subject; determine pace of the speech; and generate acamera instruction message to change zoom level or aperture setting ofthe camera based on the determined pace of the speech.
 15. A systemcomprising: a mobile device configured to receive an audio signal via amicrophone of a mobile device during video recording of a subject by acamera of the mobile device; an audio processing module configured todetermine an audio level in a vicinity of the subject based on thereceived audio signal, wherein the audio level is based on soundsproduced by the subject; and a facial recognition module configured todetect facial expression of the subject; a shot adjustment moduleconfigured to determine that the audio level or the facial expressiontriggers a shot adjustment state, and to instruct a camera controllerwithin the mobile device to dynamically adjust, in response to the shotadjustment state, one or more camera parameters of the camera to altershot of the subject by the camera during the video recording, whereinthe camera parameters relate to either zoom control, aperture, lighting,or a combination thereof.
 16. The system of claim 15, furthercomprising: a wireless communication module configured to establish awireless connection with another mobile device having a microphoneconfigured to generate a second audio signal during the video recordingby the mobile device, wherein the wireless communication module beingfurther configured to receive a second audio signal from the othermobile device, wherein the determination of the audio level is furtherbased on the second audio signal, wherein the other mobile deviceincludes a camera, and the shot adjustment module is further configuredto generate a camera instruction message to control the camera of theother mobile device according to the determined shot adjustment state.17. The system of claim 15, further comprising: a wireless communicationmodule configured to establish a wireless connection with a peripheraldevice configured to generate a second audio signal during the videorecording by the mobile device, wherein the wireless communicationmodule being further configured to receive a second audio signal fromthe peripheral device, wherein the determination of the audio level isfurther based on the second audio signal, wherein the other mobiledevice includes a camera, and the shot adjustment module is furtherconfigured to generate a camera instruction message to control thecamera of the other mobile device according to the determined shotadjustment state.
 18. The system of claim 15, further comprising: a filmmode selection module configured to select one of a plurality of filmmodes that specify pre-set settings for the parameters, wherein thedynamic adjustment is based on the selected film mode.
 19. The system ofclaim 15, wherein the shot adjustment module is further configured todetect change in the audio level outside a predetermined range, and togenerate a camera instruction message to change zoom level or aperturesetting of the camera based on the detected change.
 20. The system ofclaim 15, further comprising: a speech processor configured to detectspeech of the subject, and to determine pace of the speech, wherein theshot adjustment module is configured to generate a camera instructionmessage to change zoom level or aperture setting of the camera based onthe determined pace of the speech.